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THE EXTREMOGRAM AND THE CROSS-EXTREMOGRAM FOR A BIVARIATE 

GARCH(1,1) PROCESS 


MUNEYA MATSUI AND THOMAS MIKOSCH 


Abstract. In this paper, we derive some asymptotic theory for the extremogram and cross-extremogram of a 
bivariate GARCHfl, 1) process. We show that the tails of the components of a bivariate GARCH(1,1) process 
may exhibit power law behavior but, depending on the choice of the parameters, the tail indices of the compo¬ 
nents may differ. We apply the theory to 5-minute return data of stock prices and foreign exchange rates. We 
judge the fit of a bivariate GARCHf 1,1) model by considering the sample extremogram and cross-extremogram 
of the residuals. The results are in agreement with the iid hypothesis of the two-dimensional innovations se¬ 
quence. The cross-extremograms at lag zero have a value significantly distinct from zero. This fact points at 
some strong extremal dependence of the components of the innovations. 


1. The extremogram and the cross-extremogram 


In this paper we conduct an empirical study of extremal serial dependence in a bivariate return series. Our 
main tools for describing extremal dependence will be the extremogram and the cross-extremogram. For the 
sake of argument and for simplicity, we restrict ourselves to bivariate series X, = (Xj (,X 2 _f)', t £ Z. We 
assume that (X^) has the following structure: 

(1.1) Xf = IfZf, teZ, 


where (Z,) constitutes an iid bivariate noise sequence and 


If ^ diag(cri,(,o-2,f), t£Z, 


where cr, f is the (non-negative) volatility of X, f. We will assume that (Xf), (If) constitute strictly stationary 
sequences and that If is predictable with respect to the filtration generated by {Zs)s<t- We also assume that 
Zf = (Zi f, Z 2 ,f)' has mean zero and covariance matrix (standardized to correlations) 


( 1 . 2 ) 



P 
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where p = corr(Zi f, Z2,f). Later, we will choose parametric models for (Xf) such as univariate GARCH(1,1) 
models both for X, f, i = 1,2, or a vector GARCH(1,1) model; see Section 2.2 for model descriptions. In the 
context of these parametric models, the choice of the covariance matrix F as a correlation matrix is a matter 
of identifiability of the model since one can always swap a positive constant multiplier between If and Zf. 

The extremogram and cross-extremogram for a stationary sequence (Xf) were introduced in Davis and 
Mikosch [12] and further developed in Davis et al. [13, 14]. In standardized forms, the extremogram and 
cross-extremogram of a bivariate sequence (Xf) are given by 


where 

(1.3) 


/ Pnih) pn{h) \ 

\ P2l{h) P22(h) j ’ 


/z -0,1,2,..., 


' Pn{h) ' 


' P(Xij, e xA 1 Xi,o e xA) ' 

P22ih) 

= lim 

P(X 2 ,/, e xB 1 Xzfl e xB) 

pnQi) 

x^oo 

P(X 2 ,/f e xB \ Xifl e xA) 

. P2i(h) - 


, P(Xi,/, e xA 1 X 2 ,o €xB) , 
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Here A, B are sets bounded away from zero. Typieally, we ehoose intervals (1, cxj), (- 00 , -1) for A, B and 
we also suppress the dependenee on A, B in the p,y-notation. Notiee that xA - {xy : y e A} has interpre¬ 
tation as an extreme event if x is suffieiently large. Thus, the extremogram paQi) deseribes the likelihood 
of an extreme event at lag h given there is an extreme event in the ith eomponent at time zero. Corre¬ 
spondingly, the eross-extremogram pij{h) for i + j deseribes the likelihood of an extreme event at time 
lag h in the jth eomponent given there is an extreme event at time zero in the /th eomponent. In general, 
PiiQi) + P 2 \{h). The limits pij ean be understood as generalizations of the (upper) tail dependenee eoeffi- 
eient p - lim^-i-i P(T > F^(q) \ X > F^{q)) for a bivariate veetor {X, Y) to the time series eontext. Here 
F^(q), F^ (q) are the ^-quantiles of the distributions of X, Y, respeetively. The tail dependenee eoeffieients 
have been propagated for measuring extremal dependenee in a bivariate veetor in the eontext of quantitative 
risk management; see e.g. MeNeil et al. [21]. 

Moreover, eaeh of the quantities has interpretation as a limiting eovarianee or eross-eovarianee 

funetion. For example. 


Pn{h) 


eov(l(Xi 0 e X A), l{Xi g x A)) -t [P(Xi 0 e x A)]^ 

lim -^^^^- 

x^oo P(2fi,o G xA) 

eov(l(Xip e xA), g xA)) 

hm - 

x^oo P(2fi,o e xA) 

hm ¥{Xi^h £ xA I X\fi G xA). 


The limits pp(/i) in (1.3) do not automatieally exist. A eonvenient theoretieal assumption for their existenee 
is the eondition of regular variation of the time series (X^). This notion is explained in Seetion 2.1. Its elose 
relationship with GARCH models is investigated in Seetion 2.2. Return series are often heavy-tailed and 
therefore it is attraetive to model them by a regularly varying model. For example, under mild eonditions the 
GARCH model automatieally ensures that suffieiently high moments of the series are infinite. In partieular, 
univariate and multivariate GARCH models exhibit power laws. This will be explained in Seetion2.2. 


2. Some preliminaries 

2.1. Regularly varying time series. We say that an R'^-valued strietly stationary time series (X,) is regu¬ 
larly varying with index cr > 0 if its finite-dimensional distributions are regularly varying in the following 
sense: for every h >0, the following limits in distribution exist 

(2.1) P(x-1(Xo,...,X,,)g-||XoI>x)4p((Yo,...,Y;,)g-), x^cx,, 

where the limit veetor (Yq, ..., Y/,) has the same distribution as |Yol(0o, ■ ■ ■ , Oh), the distribution of |Yo| is 
given by P(|Yol > y) - y““, y > 1, and |Yol and (0o,..., 0/i) are independent. Of eourse, the distribution 
of 00, the spectral measure, is eoneentrated on the unit sphere = jx G : |x| = 1). The speetral 

W 

measure describes the likelihood of the direetions of extreme values of the lagged veetor Xq. Here —> 
denotes weak eonvergenee and | • | denotes any norm in R^; from now on we ehoose the Euelidean one. 
The aforementioned definition of a regularly varying time series is based on work by Basrak and Segers 
[3] whieh yields a eonvenient deseription of the topie. Davis and Hsing [11] introdueed the notion of a 
regularly varying time series whieh is attraetive for deseribing serial extremal dependenee in the presenee 
of heavy tails. They used an alternative definition of multivariate regular variation whieh is equivalent to the 
definition above. 

A direet eonsequenee of the regular variation of a time series is that 

(2.2) P(|Xol > x) = x~“L(x), X > 0, for a slowly varying funetion L, 

i.e., L is a positive funetion on (0, 00 ) sueh that L{cx)IL{x) —> 1 as x ^ 00 for any c > 0. Then we also have 

(2.3) P(Xo/|Xol e • I |Xol > x) P(0o e •), x ^ cxj. 
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Regular variation of the marginal distribution of the time series is equivalent to the set of relations (2.2) and 

(2.3) . A further eonsequenee is that P(s'Xo > x)/P(|Xo| > x) —> ea{s) as x —> oo for any ehoiee of s e 

and some funetion ea sueh that eQ,(so) 7^ 0 for some Sq e and e^its) = f“eQ,(s), t > 0. For proofs of the 
aforementioned properties and further reading on regular variation, we refer to Resniek [24, 25]. 

A partieular eonsequenee of the property of regular variation of a time series (X^) is the faet that the lim¬ 
its in (1.3), leading to the extremogram and eross-extremogram, are well defined. For this reason, we will 
assume that (Xj) is regularly varying or we will assume that a deterministie monotone inereasing transfor¬ 
mation of the eomponents X,,, / = 1,2, of Xj results in a regularly varying time series. Sueh transformations 
ean be neeessary, for example, if both eomponents are not regularly varying or if both eomponents have 
rather different tail behavior. These eases are relevant for real-life time series. For the sake of argument, 
assume that (X^) is a bivariate strietly stationary Gaussian time series. This is not a regularly varying time 
series. However, the extremogram and eross-extremogram of this sequenee exist for various sets A, B, for 
example, if A = B = (1, cxj) (a eorresponding remark applies if A or B is the set (-oo, -1)). If G denotes the 
distribution funetion of a t-distribution with a degrees of freedom then ealeulation yields that 

(2.4) (G(Bx,,o(Xi,,)), G{Fx,,,{X2,t))), f e Z, 

has G-distributed marginals and one ean indeed show that the transformed time series is regularly varying 
with index a. The same transformation arguments apply to a non-Gaussian time series. In eontrast to a 
Gaussian time series, in general one eannot ensure that the resulting time series is regularly varying in the 
sense defined above. Given fhaf a fransformafion of fhe fype (2.4) yields a regularly varying lime series, one 
ean modify fhe eross-exlremogram e.g. for fhe sels A = B = (1, cxi) in fhe following way: 

pnQi) = limP(X 2 ,/, > B£^(^) I Xi,o > B^^(^)) 

^ I 1 

- lim P(G(Bx,o(X 2 ,a)) > X I G(Bx, o(Xi,o)) > x). 

X—^OO 

For praelieal purposes, we will replaee fhe high quanliles = 1,2, by fheir empirieal versions, sueh 

as fhe 97%, 98%,... eomponenfwise empirieal quanliles, depending on fhe sample size available. 

Regular variation of a time series is a eonvenienl Iheorelieal properly buf if eannof be lesled on dafa. 
Therefore we will assume a GARCH model for (X,). This model assumption ensures regular variation. 

2.2. Univariate GARCH(1,1) models. From Bollerslev [5] reeall fhe notion of a univariate GARCH(1,1) 
model 

(2.5) Xt = (Tt Zf, t G R., 

where (Z,) is an iid unil varianee mean zero sequenee and (cr,) is a posilive volalilily sequenee whose 
dynamies is given by fhe eausal non-zero solution fo fhe sloehaslie reeurrenee equation 

(2.6) crj = ao + cki X^_y + = ao + {aiZ^.i + Pi) cr]-i ’ tel,. 

Here ao > 0 and ai > 0, ySi > 0 are eonslanls. The probabilislie slruelure of (crj) ean be invesligaled in fhe 
eonlexl of solutions fo fhe general sloehaslie reeurrenee equalion 

(2.7) T, = A,T,_i+B,, teR, 

where (A,, Bj), t e Z, eonslilules an R^-valued iid sequenee. Indeed, (cr^) satisfies Ihis equation wilh Bf = ao 
and At - a\Z^_-^ + P\. Based on fhe Iheory for Ihese equations (see Bougerol and Pieard [8]), we eonelude 
lhal a slrielly sfalionary positive solulion (cr^) fo (2.6) exisls if and only if 

(2.8) Elog(cKiZQ-i-jSi) < 0 and q'o>0- 

In view of Jensen’s inequalily and sinee EZ^ = 1, Elog(Q'iZQ -i- Pi) < logE(aiZQ -i- Pi) - log(ai -i- Pi). 
Therefore fhe eondilion ai + Pi < 1 ensures slriel slalionarily as well as seeond order slalionarily of (cTf) 
and {Xf), buf fhe eondilion (2.8) is mueh more general and also allows for eerfain ehoiees of ai,Pi sueh lhal 
ai + Pi > V, see Nelson [23], Bougerol and Pieard [8]. In Ihe latter eases, E[Xq] = co. 
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The solution to (2.7) has a rather surprising property whieh was diseovered by Kesten [18]; see also 
Goldie [16]. Under mild eonditions, there exists a positive eonstant cq sueh that P(yo > x) ~ cox~“ for 
some O' > 0. We apply the aforementioned theory to (2.6) and get the following result whieh ean be found 
in Goldie’s [16] paper as regards the marginal distributions. Mikoseh and Stariea [22] proved that (cXf) and 
(Xt) are regularly varying time series. 

Proposition 2.1. Assume that ao > 0, Zq has Lebesgue density and there exists a > 0 such that 

(2.9) E(aiZ2+A)“/2 = 1, 

and E[(aiZ^ + log''‘(Q'iZQ + jSi)] < oo. Then there exist a unique strictly stationary causal non-zero 
solutions to (2.6) and (2.5), and there exists a constant cq > 0 such that 

(2.10) P(cro > x) ~ Co X~“ , X oo . 

Moreover, as x oo, 

(2.11) P(2fo > x) ~ E[Zq] P(cro > x) and P(Zo < -x) ~ E[Zq] P(cro > x ), 

where x~ = max(0, ±x). In addition, the sequences (o't) and (Xt) are regularly varying with index a. 

Relation (2.11) is an immediate eonsequenee of (2.10) and a result of Breiman [10] about the tails of 
produets of independent random variables; ef. lessen and Mikoseh [17]. 


3. Bivariate GARCH(1, 1) processes and their properties 


Our next goal is to eonsider multivariate extensions of the GARCH(1,1) model of the 
(1.1). A simple way of doing this is by assuming that both eomponent sequenees (Xij), i 
univariate GARCH(1,1) proeesses, i.e., (Xj) in (1.1) is speeified via the veetor reeursion 


cr 


cr: 


aoi 

<X02 

aoi 

<X02 


+ 


+ 


an 

0 


0 

«22 


y2 

"^2,1- 


+ 


Ai 

0 


0 

P 22 


cr 


cr: 


l,f-l 

2 

2 , 1-1 


+/5ll 

’0 


a22Zl^_ 


+ P22 


(T 


cr: 


1,1-1 

2 

2,1-1 


type deseribed in 
= 1,2, eonstitute 


and (Z() is an iid sequenee with eovarianee matrix P given in (1.2). We ean apply the univariate theory to 
the eomponents (crj^), i = 1,2. There exist unique strietly stationary solutions / = 1,2, if and only if 
CKo,- 7 ^ 0 and E log^(aaZf^-vfin) < 0 for / = 1,2. Then we may also eonelude that the resulting unique bivariate 
proeesses (Ej) and (Xj) are strietly stationary. Notiee that the dependenee strueture between the univariate 
eomponent proeesses is then eompletely determined by the dependenee strueture of the eomponents of the 
noise (Xt). We ean also apply Proposition 2.1 to get eonditions for power law tails and regular variation of 
the eomponent proeesses of (Xj). 


Remark 3.1. The erueial eondition for the eomponentwise tail behavior is (2.9). Sinee the distributions 
of Z; o, i - 1,2, and the parameter sets (an,Pa), i = 1,2, may be distinet, Xi , and X 2 n will in general 
have dilferent tail indiees a\ and 02 , respeetively. This faet ean be eonsidered an advantage when studying 
multivariate return series. Indeed, it is not likely that the tail indiees of the univariate eomponents of real-life 
time series eoineide. 


There exist various extensions of a univariate GARCH model to the multivariate ease. We stiek here to 
the constant conditional correlation model of Bollerslev [6]. It is the model (1.1) with speeifieation 

/ aoi \ ( an an \ / \ / /3ii Pn \ ( 

\ ao2 j \ ^21 ff22 I \ Xl^_^ I \ P21 P22 I \ 

/ ffoi \ +P12 \ ( \ 

\ O'02 / \ +P2I «22Z|,_J +P22 / \ 0-2 j 


(3.1) 
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Writing W, = (cr^ ^p', 


(3.2) 


/ ffoi 
\ <3'02 


/ +^II '^^12 \ 

\ <^2lZ^(_l +^2I Q'22 Z|j_j +^22 / 


we see that we are again in the framework of the stoehastie reeurrenee equation (2.7), hut this time for 
veetor-valued and matrix-valued A,: 


(3.3) 


— A, Wf_i-I-, tcZ. 


Kesten [18] also provided the eorresponding theory for stationarity and tails in this ease. Stariea [26] dealt 
with the eorresponding problems for veetor GARCH(1,1) proeesses, making use of the theory in Kesten 
[18], Bougerol and Pieard [8] and its speeifieation to the tails of GARCH models in Basrak et al. [2]. In 
the bivariate GARCH(1,1) ease the theory in StMea [26] ean be written in a more eompaet form due to the 
representation (3.1); in the ease of higher order GARCH models (3.1) has to be written as an equation for 
veetors involving both cr^- and A^-terms at more than 1 lag. 

Aeeording to Bougerol and Pieard [8], (3.1) has a unique strietly stationary solution if the top Lyapunov 
exponent y assoeiated with the sequenee (A,) is negative, i.e., 

(3.4) y = lim n~^ log ||Ai • • • A„|| < 0, 


where || • || denotes the matrix norm and the limit on the right-hand side exists a.s. In view of Remark on 
p. 122 in [8], a suffieient eondition for y < 0 is that the matrix 


(3.5) 


EAi = 


aw + Pw <Xi2 + Pl2 I / ^11 ^12 
ff21 +^2I ff22 + P 22 / ’ \ «2I «22 


has speetral radius smaller than 1. We assume that all entries of EAi are positive. Then, by the Perron- 
Frobenius theorem (see Laneaster [19], Seetion 9.2), EAi has a dominant single positive eigenvalue. Keep¬ 
ing this faet in mind, the largest positive solution to the eharaeteristie equation det (4/ - EAi) = 0 yields the 
suffieient eondition 


in «ii+«22 , jfan - «22\2 ^ ^ ^ 

(3.6) - - - ^ ^-j +<^ 12^21 < 1. 

Next we give suffieient eonditions for the regular variation of a bivariate GARCH(1,1) proeess (Xj). The 
proof is based on Kesten’s fundamental results [18], in partieular Theorem 4. Stariea [26] gave a similar 
result, referring to Basrak et al. [2] for a related proof in the situation of a univariate GARCH(p, q) proeess. 
We give a proof by verifying Kesten’s eonditions. 


Proposition 3.2. Consider the bivariate GARCH(1,1) model and assume the following conditions: 

(1) Condition (3.4). 

(2) Zq has Lebesgue density in R^. 

(3) There exists p > 0 such that 

2 

(3.7) E[|Zo|2^1og+|Zo|] <cx, and Pij)f]>2P'\ 

’ 7=1 

(4) All entries of Aq are positive a.s., a^i >0, i = 1,2, and not all values atj, 1 < i, j < 2, vanish. 

Then there exists a unique a £ (0,2 p] such that 

(3.8) 0= limn-i logE[||Ai • • • A„ir/2], 

n—>00 

there exists a strictly stationary causal non-zero solution (X,) to (1.1) with specification (3.1) and (Kt) is 
regularly varying with index a. In particular, for every n > 1, there exists a non-null Radon measure p on 
R^"\{0) such that 


—> 00 . 


P(x ^ (Xi,..., X„) £ •) ~^ bn(') . 


X 
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V 

Here denotes vague convergence. 

Proof. According to Kesten [18], Theorem 4, there exist 

• a unique strictly stationary solution (W() to the equation (3.3), 

• a positive value a and a non-negative function Cq, on such that 

(3.9) lim v“^^P(u'Wo > x) = ea{\x ), u G , 

and the function ea is positive for u € such that u > 0 , 
if the following conditions hold: 

1. Aq > 0 and Bq > 0 and Bq 0, where C > 0 (resp. > 0) implies all entries in C are non-negative 
(resp. positive). 

2. The additive group generated by the numbers logp(ai • • -a^) is dense in R, where a,- are elements 
in the support of the distribution of Aq such that ai • • • a„ has positive entries and p is the spectral 
radius. 

3. Condition (3.4) holds. 

4. There is a > 0 such that (3.8) holds. 

5. E[||Aoir/2log+||Aol|] < cx, and E[|Bor/2] < cx,. 

Condition 1 holds in view of the assumptions Aq > 0 a.s. and Bq > 0. 

Condition 2. We assume that Aq > 0 a.s. Therefore ai • • • a„ > 0 for any n > I and any a; in the support of 
Aq. Since we assume a Lebesgue density for Zq there exists an open set in R^ where this density is positive. 
Therefore and since not all values ap vanish, there exists a continuum of values p(ai) for ai in the support 
of Ao. 

Conditions 3 and 5 follow from the assumptions. 

Condition 4. The existence of such an a follows from the existence of p > 0 such that (3.7) holds. Then 

a < p. 

Thus Kesten’s Theorem 4 can be applied. In particular, (3.9) holds. Due to results in Boman and Lind- 
skog [7] and since Wq is positive, (3.9) implies that Wq is regularly varying with index a in the sense of 
Section 2.1. 

Next we show that the finite-dimensional distributions of (W/) are regularly varying. This follows from 
the representation 

(3.10) (Wi,...,w^) = (ni,...,n,)Wo + (Ri,...,Rf), f>i, 

where Ilf = Aj • • • Ai for t > 1, (Hi,..., Ilf), (Ri,... ,Rf) have moment of order a/2 and are independent of 
Wq. Now an application of the multivariate Breiman theorem in Basrak et al. [1] yields the regular variation 
of the finite-dimensional distributions of (Wf) with index a/2, due to the regular variation of Wq with the 
same index. Hence (Ef) = ((diag(Wf))'^^) inherits regular variation with index a. Here for any matrix 
or vector x refers to taking square roots for all entries. 

It remains to show that (Xf) is regularly varying with index a. We write % = (diag(Wf - Rf))^^^. It is not 
difficult to see that |(Ef - Xf)Zf| is dominated by c|Rf|'^^ |Zf| for some constant c and this bound has finite ath 
moment. Therefore 

lim x“P(|(EiZi,...,EfZf)-(IiZi,...,IfZf)| >x) = 0, x ^ oo . 

X—^OO ' ' 

Since Wq is regularly varying with index a/2 an application of the multivariate Breiman result (see Basrak 
et al. [1]) shows that (Hi,... ,nf)Wo is regularly varying with index a/2 as well. Combining these facts, 
we conclude that 

(EiZi,...,EfZf) and (EiZj,... ,EfZf) 

have the same tail behavior and are regularly varying with index a; cf. lessen and Mikosch [17]. In 
particular, we have 


P(x-'((diag(niWo))i^2Zi,..., (diag(nfWo))i^2Zf) e • | |Wol > x) 



THE EXTREMOGRAM AND THE CROSS-EXTREMOGRAM OE MULTIVARIATE HIGH FREQUENCY DATA 


7 


4 P(yo ((diag(ni0o))^^^Zi,..., (diag(n,0o))i/2z^) £ .) ^ 

where P(yo > x) = x~“, x > 1, Pq is independent of 0o, Zi,..., Zj and 0o has the speetral distrihution of 
Wo- □ 

Remark 3.3. In view of Kesten’s result, relation (3.9) holds for any u € and eaiu) 0 for u > 0. In 
partieular, for ui = (0,1) and U 2 = (1,0) we eonelude that P(a‘, o > x) ~ CiX~" as x ^ oo, where both 
eonstants c, are positive. In turn, Breiman’s result [10] ensures that 

P(XrQ > X) ~ EliZr^f] P(a-,;o > x), X ^ oo , i = 1,2. 

This means that the right and left tails of the distrihution of Xq are equivalent and they have the same tail 
index a. This is in eontrast to the ease when = Pij = 0 for i + j (see Remark 3.1), where the eomponents 
of Xf may have different tail behavior. From a modeling point of view, this property does not allow for mueh 
flexibility as regards the eomponentwise extremes in a multivariate return series. This faet ean be understood 
as a disadvantage of the eonstant eonditional eorrelation model with respeet to more realistie modeling of 
the extremes of multivariate return models. 

The erueial eondition in Proposition 3.2 whieh makes the differenee to Proposition 2.1 is the assumption 
that all entries of Aq must be positive and random. This eondition is also satisfied if an > 0, i = 1,2, aij = 0 
and Pij > 0,i j, i.e., the off-diagonal elements in the matrix Aq may be positive eonstant. 

The ease when Aq is an upper or lower triangular matrix is not eovered by Proposition 3.2. For example, 
assume that q' 2 i = P 21 = 0. Then we have the GARCH(1,1) equation 

^2,t ~ ®02 + (Q'22Zf +^ 22 ) /-I > t eZ, 

whieh ean be solved and, under the eonditions of Proposition 2.1, has tail index a2/2 > 0. Writing Ct = 
aoi + +/5i2)o'2,f-i’ 

(Tj J = Ct + (aiiZj -1-^11) cTj , t eZ. 

This is again a 1-dimensional reeurrenee equation but now the eoeffieients 

(C/,aiiZ^^_j -I- jSii), t e Z, eonstitute a dependent strietly stationary sequenee. Appealing to Brandt [9], a 
unique eausal solution to this equation exists but its theoretieal properties are not straightforward due to the 
dependenee of the eoeffieient sequenee. However, the tail of cr^ ^ is asymptotieally at least as heavy as the 
tail of 0-2 Q. Indeed, as x ^ 00 , 

P(crj , > x) > P(Cf > x) 

> P((ai2Z|_,_i +I3n)(xl^t-i > 

~ E[{anZl,_, + PCir^, > x). 

In the last step we applied Breiman’s theorem and used stationarity. 

4. The extremogram and cross-extremogram eor a bivariate GARCH(1, 1) process 

Davis and Mikoseh [12] showed for a univariate GARCH(1,1) proeess under the eonditions of Proposi¬ 
tion 2.1 that 

Pcr{h) = lim P(cr/, > X I (To > x) 

A —>00 

= lim P(cr? > X I (Tn > x) = E[min(l, n?^^)], h> 1, 

where A, = + jSi, t e Z. While the value of these quantities is not known it is possible to determine 

their asymptotie order for large h. By eonvexity of the funetion g{h) = E[Aq] and sinee g(a/2) = 1 we have 
E[Aq] < 1 for p < ajl. Therefore 

pAh) < E[min(l,n^)] < E[n^] - , 


h>\, 
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and the right-hand side eonverges to zero exponentially fast. The extremogram of the X-sequenee inherits 
this rate. Sinee has a finite ath moment, multiple use of Breiman’s result yields 

px{h) = lim P(cr/,Z/, > X | ctoZo > x) 

X—>oo 


< 


< 


lim 


P(min(o-/,Z+, a-oZ+) > x) 


P(croZ+ > x) 


P(cro min(nf Z+,Z+) > x/2) 

/+ 


lim sup 


eonst 


P(croZ+ > x) 
E[(min(n«-5z+,Z+))“] 
E[(Z+)«] 


eonst (E[A^])" 


-I- lim sup 

X—^CO 


P(/?f z+ > 

P(o-oZ+ > x) 


Similar ealeulations ean be done in the bivariate ease. We restriet ourselves to the cr-sequenees. We 
assume the eonditions of Proposition 3.2; in this ease both eomponents i - 1,2, of the veetor W, in 
(3.3) have the same tail index. Using relation (3.10), we see that 

^ ^ ^ \ ^lo > 

Pio-^ih > x,o-^Q > x) 

= lim -- - - 

x^oo P(o-fQ > X) 

^ ,. P(|W,| > X, |Wo| > X) P(|Wo|>x) 

< hm - X-T-. 

X^OO P(|Wo| > x) ^ 


The limit of the latter ratio eonverges to a eonstant by virtue of regular variation. Thus the extremograms 
are bounded by the extremogram p|w| of (|W(|) times this eonstant. However, (3.10) and the independenee 
of Wo and R/, imply that for p < a/2, 


P|W|(^) - 


< 


< 

< 


lim 


P(|W/,| > X, |Wo| > x) 


lim sup 


P(|Wo| > X) 

>(||n,|||Wo|>x/2,|Wo|>x) 
P(|Wo| > X) 


-I- lim P(|R/,| > x/2) 


E[min(l,||n;,ir/2^] 


E[min(l,||n;,in] 

E[||n,,|in, h>\. 


The right-hand side eonverges to zero at an exponential rate in view of E[||n/,Q||^] < 1 for a suffieiently large 

ho. 


5. An empirical study of the extremogram and the cross-extremogram 


5.1. Estimation of the extremogram and cross-extremogram. Davis and Mikoseh [12] and Davis et al. 
[13] proposed estimators of the quantities Pij{h) , /i e Z, for given sets A, B bounded away from zero: 


l{Xp^h e F-/1 - 1/m) X B,Xi, e F|;/l - 1/m) x A) 
i:”=il(Z;,,GF£^(l-l/m)xA) 


(5.1) 


Pijih) ^ 


for some sequenee m = m„ —> oo sueh that m = o{n) as n —> oo. In order to ensure standard asymptotie 
properties sueh as eonsisteney and asymptotie normality, [12, 13] assumed the strong mixing eondition 
and regular variation for the sequenee (Xj), possibly after a monotone transformation of its eomponents 
as explained in Seetion 2.1. The aforementioned growth eonditions on the sequenee (m„) are standard 
in extreme value statisties and eannot be avoided. They ensure that suffieiently high thresholds E^^(l - 
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1/m), i = 1,2, are chosen. These thresholds guarantee that a certain fraction of the data is taken which 
may be considered extreme as regards their distance from the origin. For practical purposes, we take the 
corresponding empirical (1 - l/m)-quantiles of the components. 

Although central limit theory can be shown for at a finite number of lags h, the asymptotic covariance 
structure is not tractable. Davis et al. [13] propose two methods for the construction of credible confidence 
bands: fhe sfafionary boofsfrap and random permufafions. In fhis paper, we slick lo Ihe latter procedure. If is 
based on fhe simple idea lhal, if fhe sample Xi,..., X„ were iid, random permufafions of fhe sample would 
nol change ifs dependence slruclure, hence fhe exlremogram and cross-exfremogram would nol change. In 
whal follows, we calculale fhe (cross-) exlremograms based on 100 random permufafions of fhe sample. 
Firsl we calculale fhe 100 exlremogram values al each lag. Then we choose fhe 96% empirical quantile al 
each lag and finally lake fhe maximum over fhe lags of inferesl. This value is shown as a solid horizonlal 
line in fhe corresponding graphs. This procedure is quick and clean: if fhe sample (cross-) exlremogram al 
a given lag is above Ihe horizonlal line Ihis is an indication of disagreemenl wilh Ihe iid hypolhesis. 


5.2. Simulated GARCH(1,1) data. We provide a brief study of the sample (cross)-extremograms of simu¬ 
lated bivariate GARCH(1,1) processes and their residuals. We choose bivariate GARCH(1,1) models with 
iid bivariate t-distributed innovations (Z<) with 10 degrees of freedom and covariance matrix P given in 
(1.2). We simulate from the model (3.1) with parameters (aou ® 02 ) = (10“^, 10“^) (the magnitude of these 
parameters is in agreement with values estimated from return data) and specified matrices and correlations 


(5.2) 


I an <Ti2 \ / ^ii ^12 

\ ai2 022 /’ \ ^12 P22 / ’ 


We start by considering examples with p - Q (Examples (l)-(4)) and p = 0.7 (Examples (5)-(6)) with 
respective symmetric parameter matrices (5.2): 


( 1 ) 


( 4 ) 


.1 0 

0 .1 

.1 .02 

.02 .1 


.8 

0 

.8 

.04 




.1 

.05 

.1 

0 


.05 

.1 

0 

.1 


.8 0 \ 

0 .8 j’ 

.8 0 \ 

0 .8 j’ 


( 3 ) 

( 6 ) 


.1 0 

0 .1 

.1 .02 

.02 .1 


.8 .04 \ 

.04 .8 I ’ 

/ .8 .04 \ 

\ .04 .8 I 


Here we always choose small a-values while the diagonal /3-values are close to 1. This is in agreement 
with estimated parameters on return data. We generate samples of size n = 50,000, using the R package 
’ccgarch’\ and calculate the (cross)-extremograms p]y(/i) in (5.1) with A = B = (l,oo). The simulation 
results for Examples (l)-(6) are given in Eigure 1. These figures indicate that small changes in the a- 
or /3-values lead to substantial changes in the extremal dependence structure. In all cases we observe serial 
extremal dependence in exlremograms (diagonal parts of 2x2 graphs). In Examples (5)-(6) we also observe 
large spikes in the cross-extremograms at lag zero due to p 0. This is in contrast to Examples (l)-(4) with 
p = 0. Example (1) shows clear asymmetry in cross-extremograms compared with Example (2), namely, no¬ 
correlation can be can be read in the Example (1), which reflects the componentwise independence setting. 
Others exhibit dependencies in cross-extremograms to greater or lesser degrees. 

In Examples (7)-(8) and (9)-(10) we choose p = 0 and p = 0.7, respectively, and the asymmetric a- and 
/3-matrices (5.2) as follows 


(V) 


( 9 ) 


.1 0 
.07 .1 

.1 0 

.05 .1 


.8 0 
0 .8 

.8 .04 
0 .8 


(8) 1 

.1 

0 ' 

1 / -8 

.04 

0 

■1 J 

l•(o 

.8 

(10) 1 

.1 

0 ( 

1 / .8 

.07 

.1 

^2] 

l’( 0 

.6 


* Note that estimation with “ccgarch” requires choosing initial values. In most cases, we first examine componentwise univariate 
GARCHfl, 1) fits by the R package “fGarch” and then we choose these estimates as initial values. If the univariate estimation does 
not converge we try several initial values on a grid of size 0.1. In this case, the estimates sometimes differ by attaining local minima. 
Judging from the residuals, the eigenvalues of the estimated parameters (3.5) and the values of the likelihood functions, we choose 
an “optimal” estimator. Except for one case of stock return data (see Section 5.4), this procedure works. 



Figure 1. (Cross-) extremograms corresponding to Examples (1) (top left 2x2 grap 
(top right), (3) (middle left), (4) (middle right), (5) (bottom left) and (6) (bottom rig 


extremogram 


extremogram 


extremogram 


0.00 0.10 0.20 0.30 0.00 0.10 0.20 0.30 0.00 0.04 0.08 



extremogram extremogram extremogram 

0.00 0.10 0.20 0.30 0.00 0.10 0.20 0.30 0.00 0.04 0.08 



extremogram extremogram extremogram 

0.0 0.2 0.4 0.0 0.2 0.4 0.00 0.10 0.20 



extremogram 


extremogram 


extremogram 


0.00 0.04 0.08 0.00 0.04 0.08 0.00 0.04 0.08 



extremogram extremogram extremogram 

0.00 0.10 0.20 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 



extremogram extremogram extremogram 

0.00 0.10 0.20 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 































THE EXTREMOGRAM AND THE CROSS-EXTREMOGRAM OE MULTIVARIATE HIGH FREQUENCY DATA 


II 



Figure 2. (Cross-) extremograms of Examples (7) (top left 2x2 graphs), (8) (top right), (9) 
(bottom left) and (10) (bottom right). 


Figure 2 indicates that the asymmetry manifests through the a-matrix rather than the /3-matrix. Again, we 
observe large spikes at lag zero for the cross-extremograms when p 0 (Examples (8) and (10)). Example 
(10) shows the effects when diagonal elements are distinct. 

Our next goal is to show (cross-) extremograms of the residuals of simulated bivariate GARCH(1,1) 
models. Although we know the innovations sequence in this case, we want to illustrate how standard MEE 
techniques work. Of course, we expect that the residuals of the models have properties close to those of 
an iid sequence also as regards their extremal behavior. The estimation is done in two ways: (1) we fit 
component-wise univariate GARCH(1,1) models, applying MEE and assuming student t-distributions for 
the innovations; (2) following Eing and McAleer [20], we apply bivariate Gaussian quasi-MEE (QMEE). 
We consider the model (3.1) with given parameter {aoi,ao 2 ) - (10~^, 10“^) and parameter matrices (5.2) as 
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follows 


( 11 ) 


.1 0 

.05 .1 


.8 .03 

0 .8 


, P = .7, (12) 


.2 0 

.07 .1 


.7 

.02 


0 

.5 



.5 


Component-wise univariate MLE yields the following results: Despite the misspeheation of a bivariate 


Ex. (11) 

Oi 


degree for t 

Ex. (12) 

ai 


degree for t 

i = 1 

.137 

.831 

9.81 

i - 1 

.254 

.698 

10.00 

i = 2 

.169 

.802 

10.00 

i = 2 

.232 

.633 

7.88 


GARCH(1,1) model, the univariate estimation leads to reasonable estimation results exeept for the seeond 
eomponent of Example (12), where the estimated parameters are far from the true ones. 

Bivariate QMEE yields the following estimation results for parameters (5.2): 


( 11 ) 


.130 0 

.056 .125 


.778 .025 \ 
.039 .790 )’ 


.7, (12) 


.276 0 

.078 .071 


.685 .004 \ 
.004 .638 )’ 


Eigures 3 and 4 (Bottom left and right 2x2 graphs) indieate that extremal eross-dependeneies are not present 
in the residuals of bivariate GARCH(1,1) fits with the exeeption at lag 0. This is true for the bivariate QMEE 
(Eigures 3 and 4: bottom left) but, to some extent, also for the eomponent-wise univariate fits (Eigures 3 
and 4: bottom right). However, Eigure 4 (bottom right) shows that univariate fits do not remove all eross- 
dependeneies from the residuals (in this ease the degrees of freedom were not eorreetly estimated). We 
experimented with distinet parameters sets elose to those in Example (12) and we also replaeed univariate 
MEE by univariate Gaussian QMEE. In all eases, one eannot remove all eross-dependeneies of the residuals. 
Therefore bivariate GARCH(1,1) fitting is reeommended if one believes in a bivariate GARCH(1,1) model. 


5.3. An analysis of foreign exchange rates. We analyze a bivariate high-frequeney time series, eonsist- 
ing of 35,135 five minufe refurns of USD-DEM and USD-ERE foreign exehange rafes. Throughouf fhis 
subseefion we ehoose fhe 98% eomponenf-wise sample quanfiles as fhreshold for fhe sample (eross-) ex- 
fremograms. In eaeh plof fhe horizonfal line shows fhe 96% quantile obfained from 100 random permufafions 
of fhe dafa. 

The dafa exhibifs rafher sfrong eross-eorrelafions and aufoeorrelafions (see Eigure 5, lop lefl: sample 
aufoeorrelafions, lop righl: eross-eorrelafions). So if is nol unexpeeled lhal we also observe dependenee of 
fhe exlreme values of fhe Iwo series. This is apparenl in fhe exlremograms of Eigure 5 (bottom). After fitting 
a bivariate veelor AR model of order 19 lo fhe dafa whieh is ehosen by fhe “Sehwarz erilerion” (“Akaike’s 
final predielion error erilerion” proposes an order of 44), we tiffed a bivariate GARCH(1,1) model lo fhe 
residuals, by employing bivariate QMEE. The eslimaled malriees (5.2) are as follows: 


/ .214 

.013 \ 

1 .697 

.008 \ 

\ .110 

.223 )’ 

\ .280 

.663 1 


whieh satisfy fhe suftieienl eondilion for slafionarily of a bivariate GARCH(1,1) model; see (3.6). Afler 
fhe AR til, fhe eross-exlremograms of fhe residuals do nol vanish al all positive lags; see Eigure 6 (lefl) and 
Iherefore a GARCH(1,1) til for fhe residuals is reeommendable. Afler tilling fhe bivariale GARCH(1,1), 
fhe residuals exhibil exlremal eross-dependenee only al lime-lag 0; see Eigure 6 (righl). This means lhal Ihe 
eomponenls of Ihe innovations Zj exhibil exlremal dependenee. Judging from QQ-plols of Ihe residuals of 
Ihe veelor AR model and Ihe AR-GARCH(1,1) model againsl Ihe quantiles of t-dislribulions wilh 2.5 and 
3 degrees of freedom respeelively; see Eigure 7, Ihese dislribulions give a good til lo Ihe dislribulion of Ihe 
residuals. 
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Figure 3. (Cross-) extremograms in Example (11). Top left: bivariate GARCH(1,1) data. 
Top right 2x2 graphs: (Cross-) extremogram of bivariate GARCH(1,1) data, Bottom left 
2x2 graphs: (Cross-) extremogram of residuals after a bivariate QMLE fit, Bottom right 
2x2 graphs: (Cross-) extremogram of residuals after applying the eomponentwise MEE. 


5.4. An analysis of stock returns. We eonsider log-return series of three stoek priees from the NY Stoek 
Exehange: “Caterpillar Ine.”, “EedEx Corporation” and “Exxon Mobil Corporation” (“eat”, “fdx” and 
“xom” for short). In eaeh series, the raw tiek-by-tiek trade data has been proeessed into 5-minute grid 
data by taking the last realized trade priee in eaeh interval. Priees have been restrieted to exehange trading 
hours 9:30 a.m. to 4:00 p.m., Monday to Eriday, so that 78 data per day have been eolleeted in the time 
period from 2009-02-18 9:30 to 2013-12-31 16:00. The priees at 16:00 are identified wifh fhose af 9:30 of 
fhe nexf days. Sinee we eonsider fhe log-refurn series, fhe fofal size of fhe dafa is 78 x 1265 -i- 1 = 98671. 

The sample (eross-) exfremograms of fhe log-ref urns of fhe sfoek priees are shown in Eigure 8, where 
we ehoose fhe empirieal 0.99 quanfiles of fhe refurns as fhe fhreshold. We fake fhe 97% quantile obfained 
from 100 random permufafions of fhe dafa and show fhe values as fhe horizonfal line in eaeh plof. Allhough 
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Figure 4. (Cross-) extremograms in Example (12). Top left: bivariate GARCH(1,1) data. 

Top right 2x2 graphs: (Cross-) extremogram of bivariate GARCH(1,1) data. Bottom left 
2x2 graphs: (Cross-) extremogram of residuals after a bivariate QMLE fit. Bottom right 
2x2 graphs: (Cross-) extremogram of residuals after applying the eomponent-wise MEE. 

we observe typieal GARCH(1,1) (eross-) extremograms elose to lag 0, there is a elear seasonal eompo- 
nent in these plots, appearing as spikes at lag 78, eorresponding to the beginning and end of the days. A 
GARCH(1,1) model (bivariate or eomponent-wise univariate) eannot explain the seasonal extremal eom- 
ponents in the data. However, the (eross-) extremograms of the residuals after a bivariate GARCH(1,1) fit 
show that most of the serial dependenee has been removed from the data, although the seasonal eomponent 
is also present in the residuals; see Eigure 9. 

We fit a bivariate GARCH(1,1) model to eaeh pair of stoek priees, i.e., (eat,fdx), (fdx,xom) and (eat,xom). 
The estimated values of the bivariate QMEE (5.2) for (eat,fdx), (fdx,xom), (eat,xom), respeetively, are 

/ .215 .210 \ / .666 .144 \ / .178 .000 \ / .712 .115 \ 

\ .029 .287 .002 .668 j’ \ .006 .250 j’\ .007 .666 j’ 
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Figure 5. Five minute log return series of USD-DEM and USD-FRF foreign exchange 
rates. Top left: The sample autocorrelation functions for each series. Top right: Cross¬ 
sample autocorrelation functions. Bottom 2x2 graphs: (Cross-) extremograms of the 
original data. (Cross-) sample autocorrelations oscillate strongly and show rather strong 
dependencies in every other lags. (Cross-) extremograms take over this tendency. 
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Figure 6 . (Cross-) extremograms of residuals after AR and AR-GARCH fits. Left 2x2 
graphs: (Cross-) extremograms of residual after AR fit. Right 2x2 graphs: Those after 
AR-GARCH fit. The serial (cross-) extremal dependence still remains in residuals of an 
AR fit, while it has been removed in the residuals after an AR-GARCH fit except for lag 0. 






Figure 7. QQ-plots of residuals after AR fit (top) and those after AR-GARCH(1,1) fit (bottom). 

The estimators of the combination (cat, fdx) are unstable and take the boundary value^ of the sufficient con¬ 
dition (3.6) while the estimates for (fdx, xom) and (cat, xom) satisfy (3.6). The obvious seasonal component 

In this case, the univariate GARCH(1,1) fit does not converge. Therefore we examine several initial values for “ccgarch” on 
a grid of size 0.1 and choose an “optimal” value based on their likelihoods. We also tried several optimization methods included 
in “ccgarch”. Then we calculated the eigenvalues of (3.5) from the estimates, including the “optimal” ones. However, the largest 
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cat fdx xom 
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lag 

Figure 8 . (Cross-) extremograms of log-return series of 3 stoek priees (eat, fdx, xom). 

Graphs show strong serial extremal dependenee in eaeh series together with strong extremal 
dependenee between 3 series. Other than large spikes at lag 0 in eross-extremograms, we 
observe spikes at lag 78, which show seasonal fluctuation in a day. Moreover, extremal data 
around the begging 9:30 a.m. and the end 4:00 p.m. may exhibit strong dependence. 

of the data (corresponding to the end of a trading day at lag 78) probably violates the stationary condition. 
Nevertheless, the standardized residuals appear “de-volatilized” in all (cross-) extremograms modulo the 
fact that the seasonal component is always present. 

We take QQ-plots of the residuals after bivariate GARCH(1,1) fits against the quantiles of t-distribution 
with 2.5 ~ 3.5 degrees of freedom respectively; see Figure 11. From these plots, t-distributions show a good 
fit to the distribution of the residuals, which also assures that innovations of GARCH(1,1) model satisfy 
the regular variation assumption. Only residuals of ’xom’ components (bottom left and bottom right in 
Figure 11) seem to fit t-distribution with different degrees, depending on the pair of stock prices in bivariate 
estimations. 

As predicted, estimated volatilities are affected by periodicity of the day, which is also approved in (cross- 
) autocorrelation functions of estimated volatility processes in Figure 10. Since the seasonal patterns in these 
plots are quite clear and intuitive, it is desirable to remove the seasonal component for further analysis. 

eigenvalues are very close to one in all cases. Since “ccgarch” finds the optimal value under the sufficient condition (3.6), the real 
optima would certainly violate (3.6). 
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Figure 9. (Cross-) extremograms for residuals of bivariate GARCH(1,1) fits to combina¬ 
tions (cat, fdx), (fdx, xom) and (xom, cat), so that we have two extremograms in each row, 
i.e. cat-f and cat-x are those for residuals of ’cat’ components respectively from bivariate 
QMLE of (cat, fdx) and (xom, cat). Other elements are cross-extremograms for residuals of 
(cat, fdx, xom) against (cat, fdx, xom). Although, residuals show less extremal dependence 
except for large spikes at 0, we could not remove the seasonal component at lag 78. 

We further investigated the seasonal effects by plotting the number of large values in each 5-minute grid 
during the exchange trading hours; see Figure 12. The large values tend to appear around the begging and 
end of the trading hours. This is typically observed in the log-return series of stock price data. 
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Figure 10. (Cross-) autocorrelation functions for estimated volatility processes by bivari¬ 
ate GARCH(1,1) fits. Left 2x2 graphs: (Cross-) autocorrelation functions for estimated 
volatilities after bivariate GARCH(1,1) fits to the pair (cat, fdx). Middle 2x2 graphs: 
Those for the pair (fdx, xom). Right 2x2 graphs: Those for the pair (xom, cat). In all 
(cross-) autocorrelation functions, one could observe clear seasonal effects by a day cycle ( 
we have 78 of 5-minute intervals per day from 9:30 to 16:00.). 








Figure 11. QQ-plots of the residuals after the bivariate GARCH(1,1) fits against the quan¬ 
tiles of f-distributions. Top left and middle: QQ-plots for residuals of ’cat’ and ’fdx’ com¬ 
ponents respectively, after the bivariate GARCH(1,1) fits to the pair (cat, fdx). Top right 
and bottom left: Those for residuals of ’fdx’ and ’xom’. Bottom left and right: Those for 
residuals of ’cat’ and ’xom’. 
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5 minute grids from 9:30 to 16:00 


Figure 12. Frequency of large values of log-return series in each 5-minute grid in a day. 
There are 78 grids in a day and we chose values larger then the upper 0.99 empirical quan¬ 
tiles of 78 X 1265 = 98670 data. In all cases, large values concentrate around the beginning 
and end of exchange trading hours. 
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